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ABSTRACT . 



A method and apparatus for providing a dynamic caching 
system is described. The apparatus for dynamic caching 
comprises a UCI creator to create a unique content identifier 
for a request for a requested data set, proxy receiving logic 
to receive the requested data set from the origin server, and 
a compilation engine to create a compile object from the 
requested data set. The apparatus further comprises an 
assembly engine to, on a subsequent request for the data set. 
interpret the compile object to create the requested data set. 
The apparatus further comprises a response logic to serve 
the requested data set to a requester, without impacting the 
origin server. 
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METHOD AND APPARATUS FOR A panying drawings and in which like reference numerals refer 

DYNAMIC CACHING SYSTEM to similar elements and in which: 

FIG. lA is a block diagram of a network that may be used 
RELATED CASES present invention. 

The present application is a Continuation-in-Part of U.S. ^ FIG. IB is a block diagram of one embodiment of a 

patent application Ser. No. 09/312^08, 61ed May 14, 1999, computer system. 

entitled "Client-Server Independent Intermediary FIG. 2 is a block diagram of one embodiment of the 

Mechanism", now U.S. Pat. No. 6,505,230. dynamic application caching engine in accordance with the 

FIELD OF THE INVENTION ^° '"r' . H" f H H' . f .H 

FIG. 3 A is a block diagram of one embodiment of the 

The present invention relates-to caching, and more policy and routing engine. 

specificaUy, to caching dynamic content. pio. 3B is a block diagram of one embodiment of the 

BACKGROUND assembly engine and response logic. 

15 FIG. 4 is a block diagram of one embodiment of the 

The competition among web applications on the Internet compilation engine, 

is continuing to increase. To provide economic value, web pi^ 5 ^ bio^k diagram of one embodiment of the policy 

applications must offer content that is current, compelUng, engine 

targeted to user iDterests and needs and rich in information. ^ ^ ^ embodiment of routing a 

Accordingly, web sites are providing dynamic content to 20 . 

meet such demands. However, as web sites transition from T^^^ - a t . 1 j- . r 

static to dynamic content, the business tension between the f .^^"^^T^^^f^' embodiment of creaUng a 

need for improved website performance and sky-rocketing ^^^^^ 

costs of web operations continues to mount. In particular, "^^^^ ^ flowchart of one embodunent of assembhng 

many web sites face the challenge of expanding to include 25 a response to serve dynamic content to a user. 

more personalized, dynamic content, improving FIG. 7B illustrates one embodiment of executing the 

performance, while simultaneously reducing the costs of instructions of tiie compile object. 

web operations. The explosion of dynamic content, person- FIGS. 8A and 8B are fiowcharLs of one embodiment of 

alization and more sophisticated content management appli- handling data served by the data server. 

cations is significantiy increasing the value of each web site 30 pjQ gc is a flowchart of one embodiment of compfling 

browsing experience. However, such features for a web site a page to create a compile object. 

are also bogging down backend systems, thereby creating piQ 9 illustration of one embodiment of a compile 

performance, scaling, and cost headaches. object 

A current approach to such problems includes a never- pjQ 10 is an illustration of one embodiment of creating 

ending build-out of additional servers and software. In ^ unique URL 

addition to the new capitd equipment, sucii an approach pjg ^ \ Qowcban of one embodiment of using 

typicaUy requires hinng of extra staff to manage the new ,^ invaUdate compile objects in the cache. 

web mfrastnicture. 

Another typical approach to such problems includes con- DETAILED DESCRIPTION 

ventional caches that store and retrieve copies of static a method and apparatus for a dynamic caching system is 

objects, such as bitmaps and pictures. However, because described. Tie dynamic caching system includes two 

web sites are gravitating to more dynamic content, conven- portions, the inline server and the offline server. The inline 

tional caches are not able to cache most web pages, ^^^^^ ^ f^^^ ^ ^gji^^ 

Furthermore, naany web pages include content such as server is used to calculate the time to live of objects, as well 
personalized mformation, and transient data, which cannot ^ ^^j^ ^^^^.^ j-^y ^^^^^ 

be cached by conventional systems. Therefore, the conven- • i- ^ ^^„r^^ ^,v*ot*j 

, , ^ . jr Ihe mime server receives requests directed to an ongm 

tional caches used carmot be used for much of the content. ^ j • 7 , • * * 

server. The dynamic caching system creates a unique content 

SUMMARY OF THE INVENTION identifier (UCI) for the request. The UCI includes relevant 

50 parameters. Then, based on the UCI, the system determines 

A method and apparatus for dynaniic caching is whether the requested data exists in the cache, and is fresh. 

described. A method and apparatus for providing a dynamic if so, tiie data is served from the cache. Transient content — 

caching system is described. The apparatus for dynamic e.g. content that changes with every response, such as ads 

caching comprises a UCI creator to create a unique content and personalization — is placed within the served data auto- 

identifier for a request for a requested data set, proxy 55 matically. If the data is not fresh, or not in Oie cache, it is 

receiving logic to receive the requested data set from the fetched from the origin server and served to the requester. 

origin server, and a compilation engine to create a compile jhe data fetched from the origin server is compiled, to form 

object from the requested data set The apparatus further a compile object, which can be used to reconstruct the 

comprises an assembly engine to, on a subsequent request original data. The compile object includes two portions, data 

for the data set, interpret tiie compile object to create the and instructions. The data is the "static** content, whQe the 

requested data set. The apparatus further comprises response instructions indicate how to assemble the data and insert any 

logic to serve the requested data set to a requester, witiiout transient content required. The compile object is compared 

impacting the origin server. vvith tiie version in the cache, if there is one. For one 

BRIEF DESCRIPTION OF THE DRAWINGS T^^'fl CRC of the compile object is ^ompared wiOi 

65 tiie CRC of the cached version. For one embodiment, the 

The present invention is illustrated by way of example, CRC is part of the metadata kept about the object in the 

and not by way of limitation, in tiie figures of the accom- cache. The new data is compared to the old data, and this 
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informatioQ is passed to the ofiQine server The offline server dyaamic caching engine 100. For another embodiment, 

generates a function to determine the time-to-live. The multiple dynamic caching engines lOOCl, 100C2 may be 

comparison information along with the function generated coupled to a single server 120C. In that instance, for one 

by the offline server is used to recalculate the object's time embodiment, cache coherency is provided for by dynamic 
to live. 5 caching engine lOOCl, 100C2, as will be described in more 

HG, lA is block diagram illustrating a network including ^'^l^^' Alternatively, a single dynamic cach^^ engine 

some embodiments of the present invention. The netwo^ ^^t'^'l I'f 'fT"" ^^^^l' 

includes data object servers 120A-C and associated FIG. IB illustrates a block diagram of a computer system 

dynamic appUcation cache servers that comprise dynamic may be used wiOi the present invention, accorcMng to 

caching engmes lOOA-C. 10 embodiment of the present invention. Although 

^ * ^ ^ . described m the context of a computer system 150, the 

As shown, the network mcludes clients 130, which are present invention may be implemented in any suitable 

coupled to network 140. In an embodiment, clients 130 are computer system. It will be apparent to those of ordinary 

computing devices, such as cUent computers. For example, skill in the art that alternative systems of various system 

clients 130 can include a number of different notebook or architectures may also be used. 

desktop computers, and network 140 comprises the Internet. xhe data processing system illustrated in FIG IB 

In an alternaUve embodiment, network 140 comprises an includes a bus or other internal communication means 165 

Intranet, a local area network (LAN), a wide area network for communicating information, and a processor 160 

(WAN), or an ahernative network. coupled to the bus 165 for processing information. The 

Additionally, a dynamic caching engine 100 is also ^ system further comprises a random access memory (RAM) 

coupled to network 140, while data object server 120 is or other volatile storage device 155 (referred to as memory), 

coupled to dynamic caching engine 100. The dynamic coupled to bus 165 for storing information and instructions 

caching engine 100 is made up of one or more dynamic to be executed by processor 160. Main memory 155 also 

application cache servers. Accordingly, in an embodiment, may be used for storing temporary variables or other inter- 
communications between clients 130 and data object server ^ mediate information during execution of instructions by 

120 pass through a dynamic application cache server. As will processor 160, The system also comprises a read only 

be described in more detail below, in an embodiment, a memory (ROM) and/or static storage device 175 coupled to 

cache 110 associated with dynamic caching engine 100 bus 165 for storing static information and instructions for 

stores a representation of a data object that is stored in the processor 160, and a data storage device 170 such as a 

data object server 120. In one such embodiment, the repre- magnetic disk or optical disk and its corresponding disk 

sentation of the data object includes data and logic describ- drive. Data storage device 170 is coupled to bus 165 for 

ing the data object. Thus, when the data object is requested, storing information and instructions, 

the data object can be reconstructed and served to a request- Jhe system may further be coupled to a display device 

ing device, such as client 130, based on this data and logic. 185, such as a cathode ray tube (CRT) or a liquid crystal 

Moreover, in one embodiment, dynamic caching engine 100 display (LCD) coupled to bus 165 through bus 180 for 

stores a time-to-live period or expiration time for the data displaying information to a computer user. An alphanumeric 

object. Accordingly, if the data object is being requested input device 190, including alphanumeric and other keys, 

from data object server 120 by a client 130, and a valid may also be coupled to bus 165 through bus 180 for 

representation of this data object is stored in cache HO, communicating informaUon and command selections to 

dynamic caching engine 100 transmits the reconstruction of processor 160. An additional user input device is cursor 

the data object to the requesting device 130 without retriev- control device 195, such as a mouse, a trackball, stylus, or 

ing the data object from data object server 120, This cursor direction keys coupled to bus 165 through bus 180 for 

decreases the load on data object server 120. communicating direction information and command selec- 

While different embodiments of the present invention tions to processor 160, and for controlling cursor movement 
may have different types of communication protocols among 45 on display device 185, 

clients 130, dynamic caching engine 100, and data object Another device, which may optionally be coupled to 

server 120, in an embodiment, the co mmuni cation protocol computer system 150, is a communication device 199 for 

is the Hyper Text Transfer Protocol (HTTP). Moreover, in accessing other nodes of a distributed system via a network, 

one such embodiment, the communication protocol is The communication device 199 may include any of a 
upgraded to Secure-HTTP (HTTPS) to allow for increased 50 number of commerciaUy available networking peripheral 

security. devices such as those used for coupling to an Ethernet, token 

In one embodiment, network 140 is a local area network ring, Internet, or wide area network. The communication 

(LAN). In another embodiment, network 140 is a wide area device 199 may further be a null-modem connection, or any 

network (WAN), In one embodiment, network 140 is the other mechanism that provides connectivity between the 
Internet. Further, network 140 can be a combination of 55 computer system 150 and the outside world. Note that any 

different networks that provide communication among cli- or all of the components of this system illustrated in FIG. IB 

entsl30, dynamic caching engine 100 and data object server and associated hardware may be used in various embodi- 

120. Moreover, to allow for increased security virtual private ments of the present inventioa 

networks (VPNs) can be established between a given device It will be appreciated by those of ordinary skill in the art 
130, 120 and dynamic caching engine 100. go that any configuration of the system may be used for various 

In one embodiment, a dynamic application cache server purposes according to the particular implementation. The 

lOOA is coupled to cache UOA. For one embodiment, a control logic or software implementing the present invention 

dynamic cache server lOOA may comprise multiple servers. can be stored in main memory 155, mass storage device 170, 

These servers may perform load balancing. For one or other storage medium locally or remotely accessible to 
embodiment, multiple dynamic caching engines lOOCl, 65 processor 160, 

100C2 may be coupled to a cache 110. For another It will be apparent to those of ordinary skill in the art that 

embodiment, multiple caches 110 may be coupled to a single the system, method, and process described herein can be 
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implemented as software stored in main memory 155 or read object is identical to the expired compile object in the object 

only memory 175 and executed by processor 160. This store 285. Updating logic 280 updates the compile object in 

control logic or software may also be resident on an article the cache. Updating logic 280 also passes the data — e.g. 

of manufaaure comprising a computer readable medium time, whether or not the fetched version was different from 

having computer readable program code embodied thcreiD 5 ^jje oliginal to activity /change data 235. 

and being readable by the mass storage device 170 and for 1. ,. . 

X. i^n , . ■ J -.1. .u Freshness engine 230 uses the policy data 225, as well as 

causing the processor 160 to operate in accordance with the , i> y y^a,^ 

methods and teachings herein. actmty/changc data 235 to create an equation to calculate a 

•me present invention may also be embodied in a special f'^^^^'J^"^ ^ object store 285. The updating 

purpose appUance including a subset of the computer hard- logic 280 updates the Umc-to-Iive of the compile object. For 

ware components described above. For example; the appU- one embodiment, fr^hness engine 230 is m an ofDme server, 

ance may inchide a processor 160, a data storage device 170, P"^'""^ °^ thesystem that respond to a request are 

a bus 165, and main memory 155, and communications T." T'^'-u^- calciUatwn, for one 

mechanism 199. In general, the more special-purpose the !n,^^Z?fi,'^ in oopendmg apphcation Sen No. 

device is, the fewer of the elements need be present for the l?'^*^^^^ <=^''°»'^^^]y herewith, enUtled ' UpdaUng 

device to function. In some devices, communications with "P"'^ '^5?^"' '^PP'^^f 9":^^ ■ °^ 

the user may be through a touch-based screen, or similar Jesejxjmponenis of the system is described m more detail 
medianism. 

It wiU be appreciated by those of ordinary skiU in the art ^ ^ ^^^^^ ^'^^'^^ ^^5^^°^ of tmho^- 

that any configuration of the system may be used for various on P^^^^y ^^^ine and routmg engine. The request 

purposes according to the particular implementation. The user— which was determined by policy engine to be 

controllogic or software implementing the present invention cacheable— is passed to URL transformer 305. The URL 

can be stored on any machine -readable medium locally or (uniform resource locator) transformer 305 transforms the 

remotely accessible to processor 160, A machine-readable ^ canonical forai. The rule matcher 310 deter- 

medium includes any mechanism for storing or transmitting P^^^ ^^^^ 225 that 

information in a form readable by a machine (e.g. a prohibitsservmgtherequest&omthecache.If so. the proxy 

computer). For example, a machine readable medium ^^^^^ ^^g^^ P^^^^^ ^^^^^^t to the origin server, 

includes read-only memory (ROM), random access memory If ^® request is cacheable, the UCI (unique content 

(RAM), magnetic disk storage media, optical storage media, identifier) creator 320 creates a unique identifier for the 

flash memory devices, electrical, optical, acoustical or other 30 request. The UCI creator 320 includes a parameter identifier 

forms of propagated signals (e.g. carrier waves, infrared 322, a parameter categorizer 324, and an ordering logic 326. 

signals, digital signals, etc.). The output of UCI creator is a unique content identifier, 

FIG. 2 is a block diagram of one embodiment of the "^^^^^ includes all relevant parameters. The relevant param- 

dynamic application caching engine in accordance with the ^® ^^^^^ ^® P^^^^y ^^y ^« 

present invention. Request receiving logic 210 receives a 35 embodiment, parameters that are missmg from the request 

request fi-om a client. The request is directed at the origin included as place-holders. 

server (not shown), and dynamic caching engine 100 inter- As shown in FIG. 10, the various parameters, included 
cepts the request. The request is then passed to policy engine with the request 1010, are parsed. For example, a response 
215, which uses the pohcy data 225 to determine whether going to a request from the America On-Une (AOL) net- 
the request can be served by the dynamic cadiing engine 40 ^^^^ ^^"^^ ^ different response than one going to a 
100. If the request cannot be served, based on policies set by corporate user. In the example, however, corporate users 
the user using policy user interface 220, the request is from any corporate interface may receive the same response, 
proxied to the origin server. If the request can be served, the Therefore, the parameter identifying the user's originating 
process continues to the routing engine 250. The routing server may be categorized. Thus, a parameter may be 
engine 250 determines whether the requested object is in the 45 reduced to one of a set of categories. For example, in HG. 
cache, and if so, whether the object in the cache is still valid. example shows parameter B being categorized as 
Validity in this context refers to a data object that has not yet "low," "high," or "none." These categories can be any set of 
expired (e.g. its time to live is non-zero), and has not been categories. For example, the categories may be "member," 
invalidated for another reason, such as a cache flush or "first time guest", "returning guest." Any other set of cat- 
policy based invalidation. These concepts are described and 50 egories may be defined. These categories are defined by the 
discussed in more detail below. If the object in the cache, is ^r, using policy interface. 

valid, the routing engine 250 passes the request to assembly Certain other parameters may be directly represented. For 

engine 255. Otherwise, the routing engine 250 proxies the example, the page on the same site from which the user came 

request to the server. The assembly engine 255 uses the may directly affect the displayed information. FIG. 10 

compile object in object store 285 to recreate the dynamic ss Ulustrates this in parameter A. Certain other parameters may 

response for the tiser, which is then returned to the user by be discarded, as shown with parameter C. And certain 

response logic 260. The fact that a request has been served parameters may be missing in the original request 1010. 

from the cache is then passed to freshness engine 230 for its However, the UCI 1030 includes a placeholder for the 

analysis. missing parameter, as can be seen with respect to parameter 

If the request was proxied to the origin server, because it 60 D. This permits the resulting UCI 1030 to have a canonical 

either could not be found in the cache or was not valid, the form, regardless of which parameters were present and 

response from the origin server is received by proxy receiv- missing from the original request 1010. 

ing logic 265. Compilation engine 270 creates a compile Returning to FIG. 3A, the UCI, in canonical fonnat, is 

object fixjm the response. The compile object includes tested by cache tester 330 to determine whether it can be 

instructions and data, for one embodiment. The compile 65 found in object store 285. If the data from the same UCI has 

object is passed to change detection logic 275. Change been served in the past, and has not been purged, then it can 

detection logic 275 determines whether the new compile be found in the object store 285. If the data is not in the 
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cache, the request is passed to the proxy service logic 315, The execution logic 360 executes the instructions of the 

to request the response from the origin server. If the data is compile object to reconstruct the response for the requester, 

in the cache, the request is passed to freshness tester 335, The execution logic 360 interacts with transient logic 370 

Freshness tester 335 determines whether the data in the and embedded extension logic 375. Transient logic 370 

object store 285 is fresh. Each data has associated with it a 5 permits the insertion of data that changes for each user, 

time-to-livc or "freshness" value. The data in the object store Transient information may be the random number that 

285 is considered fresh only for a preset period. For one identifies each unique response to an advertisement like 

embodiment, the freshness tester 335 performs a calculation Doubleclick's, personalization, or other similar transient 

to evaluate the freshness of the object. If the object is not elements. Embedded extension logic 375 permits the system 

considered fresh, the request is passed to availability logic 10 to comply with the Edge Side Includes (ESI) standard. 

345. If the object is fresh, but override logic 340 determines Furthermore, the embedded extension logic 375 permits the 

that the data should be served from the origin server, the assembly engine to obtain certain elements from the origin 

request passes to availability logic 345. server. 

Override logic 340 determines whether a policy, in policy This data is passed to the assembly logic 365, which 

data 225, overrides the freshness determination of freshness ^5 assembles the final response, and sends it to the user, 

tester 335, If the freshness determination is not overridden, through response logic 260. The assembled response is also 

override logic 340 passes the request to assembly engine, to sent to logging logic 380. Logging logic 380 logs the time, 

assemble the response based on the content in the object and other relevant details. Tliesc details arc used by the 

store. Otherwise, the request is passed to availability logic freshness engine (not shown) to calculate subsequent fresh- 

345, 20 ncss equations. 

Availability logic 345 determines whether the origin FIG. 4 is a block diagram of one embodiment of the 

server is avaUable. Occasionally, the origin server becomes compilation engine. The compilation engine 270 receives 

unavailable temporarily. For example, if too many requests the proxied data returned from the origin server. The loading 

are being served from the origin server, it may be unavail- logic 410 receives the proxied data. Cacheability tester 415 

able. Alternatively, if the server goes down for any reason, determines whether the returned data can be cached. This is 

it may be unavailable. If availability logic 345 determines determined using the policies set by the user, and recorded 

that the origin server is available, it passes the request to as policy data. For one embodiment, data may be excluded 

proxy service logic 315. Otherwise, it passes the request to by class — for example pages which request user input or 

timing logic 347. pages which are secure (e.g. HTTPS), Alternatively, pages 

Tmaing logic 347 determines whether the data is sufE- may be individually excluded, by URL, or some other 

ciently fresh to serve if the origin server is unavailable. For identification means. If the cacheabiUty tester 415 deter- 

one embodiment, timing logic 347 further uses policies set mines that the page is not cacheable, it is discarded, 

by the user, to determine whether the request can be served Otherwise, it is passed on to compilation engine 270. 

from the (expired) cache. If the request can be served from ^5 Th^ compile/ESI logic 435 uses element separator 425, 

the cache, timing logic 347 passes the request to assembly ESI/Tag analyzer 430, and VM code generator 440 to create 

engine. Otherwise, timing logic passes the request to error the compile object from the data. The element separator 425 

page server 349. Error page server 349 serves an error page, identifies the elements in the data. These elements include: 

For one embodiment, the error page served may be the data, transient elements, personalization, and other ele- 

expired data with a notification that the data on the page is ments. Element separator 425 separates the data into mul- 

expircd. This means, that if the origin server is down, the tiple elements, VM code generator 440 generates the instruc- 

requester is not simply served a "404 Page Unavailable" tions to put the elements back together. ESI/Tag analyzer 

error, but may rather be served an informative page, which 430 recognizes ESI compliant, and other types, of tags, 

may in fact include the data the requester was seeking. These tags are in the original web page, indicating how to 

FIG. 3B is a block diagram of one embodiment of the 45 handle each tagged element. One example of these tags is 

assembly engine and response logic. The loading logic 350 described at www.esi.org. Alternative lags may be set up by 

receives the UCI from the routing engine. The loading logic Itc user. The disadvantage of using such tags is that each 

350 retrieves the data from the objector store 285. The data P^ge must be tagged, and whenever a page is updated, the 

is a compile object. FIG. 9 is an illustration of one embodi- ^gs must be updated appropriately. However, the present 

ment of a compHe object. As can be seen in FIG. 9, the 50 system does accept such tags. 

compile object 920 includes two portions, data 940 and The output of the compilation engine 270 is passed to 

instructions 950. For one embodiment, the compile object CRC logic 450, CRC logic 450 performs a CRC (cyclic 

920 may have two elements as well, a compressed element redundancy checksum) operation, or similar operation that 

960 and an uncompressed element 930. Each element 930, results in a checksum. For one embodiment, CRC logic 450 

960 includes a data portion 940, 970 and an instruction 55 creates a 128-bit CRC of the compile object. Note that by 

portion 950, 980. This permits a response to a requester than using the compile object, which includes instructions and 

can accept compressed data, without requiring on-the-fly data, the transient elements arc automatically excluded from 

compression, which is lime-consuming. By storing the com- the CRC, and thus do not affect the comparison. Cache 

pressed element 960, the compressed response is served as checker 455 determines if a copy of the data is already in the 

quickly as an uncompressed response. gQ cache. If so, it passes the CRC to the compare logic 460. 

Returning to FIG. 3B, the compile object is passed by Otherwise, it passes the CRC and compile object to updating 

loading logic 350 to compression tester/chooser 355. Com- ^^gic, to be entered into the object store 285. 

pression tester/chooser 355 determines whether to use the The compare logic 460 determines whether the version of 

compressed element or the uncompressed element of the the data in the object store 285 has the same CRC as the 

compile object. For one embodiment, the compile object 65 newly obtained data. For one embodiment, one of the 

may not have both a compressed and uncompressed version. metadata elements associated with the compile object in the 

In that case, this element may be removed, object store 285 is the CRC. Thus, the CRC of the compile 
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object in the cache need not be computed ai this point. The At block 612, the URL and its associated parameters are 

results of the comparison are passed to updating logic. identified. The parameters may be included in the request 

Updating logic then either updates the version in the object itself, may be part of a cookie associated with the request, or 

store 285, if the new version is different firom the old may be conveyed to the system in another way. 

version, or updates the associated metadata, if the new 5 At block 614, the process determines whether the data can 

version is the same as the old version. In this way, the system be served firom the cache. The data may not be served from 

receives data from the origin server, compiles it to create a the cache if the page is designated as uncacheable according 

compile object, and places a copy of the compile object in to the policy. If the data cannot be served from the cache, the 

the object store 285, if appropriate. process continues to block 616. 

FIG. 5 is a block diagram of one embodiment of the policy 10 At block 616, the process determines whether the origin 

engine. The system illustrates how a user may set policies. server is available. If the origin server is available, the 

In general, the user sets a "universal policy" 530 for all process continues to block 618, and the URL and parameters 

pages. For one embodiment, the universal policy 530 may passed to the origin server for serving. If the origin server 

include one or more of the following: is not available, the process continues to block 636. At block 

Freshness level: the overall freshness level of data served. ^ stand-in page is served. As discussed above, the 

This is the goal freshness level used by the freshness stand-m page is defined by the policy. The process ten ends 

engine to calculate time-to -live for various compile ^* ^4*^^^^?^* , , , 

objects. block 614, the data was determined to be cacheable, 

™t --a .u * • .1.* -J * f the process continued to block 620. At block 620, a imique 

TTLovernde: the triggers that overnde the tune-to-live ^„ Tir-T ™ * ^ • *u i * * a 

. . , -1 i_- * ^ UCI is created, mcorporatmg the relevant parameters. As 

attached to compile obiects. j ■ j u i . . l 

^ discussed above, the relevant parameters may be a parameter 

Unavailability Timer: a timer indicating how long an category, a stand-in for a missing parameter, or the param- 

expired page should be served, if the origin server is etgj- itself. 

unavailable. yVt block 622, the process determines whether the object 

Parameters: this is the list of parameters that are received 25 corresponding to the UCI has been cached. Because the UCI 

with a request, in order, such that a constructed UCI has is unique, and consistent across all requests, the system may 

the canonical form. determine whether the particular UCI has been cached. If it 

Parameter categories: certain parameters are categorized, been cached, the process continues to block 616, 

as described above. This identifies those parameters, where it determines whether to proxy the request to the 

and the categories for them. 30 origin server or to serve a stand-in page. If the UCI has been 

Transient Data Elements: identifies the types of transient ^^'^^^^^ ^'"""^^ continues to block 624. 

data elements that may be present in the data. The ^^^^^ ^^^^^ determmes whether the data m 

transient elements include personalizaUon, randomized ^^^^^ vaUd/fresh. The data is valid if it has not been 

elements, cycled elements, etc. mvalidated by a triggermg event. A tnggermg event may be 

Ti ^. ^. -A .-n 1 . 35 a change in the database, a deliberate intervention, or an 

PersonalizaUon opUons: identifies the personahzation ^^^^^^^^ invalidation, upon the occurrence of certain 

options. In general, personalization is earned through ^^^^^ ^ .^^^^^^^^^ ^^^^ 

from the request/cookie associated with the request, events. Hie data is considered fresh if the time-to-Uve period 

Uncacheable designation: identifies particular pages, por- has not yet expired. If the data is vahd and fresh, the process 

Uons of pages, types of pages, etc. that are designated 4q continues to block 626. At block 626, the UCI is passed to 

uncacheable. May also include identification of a tag, the assembly engine, to assemble a response to the request, 

which may be attached to uncacheable pages. jhe process then ends at block 628. If the data is either 

Error page layout: designs an error page, presented when invalid or not fresh, the process continues to block 630. 

the origin server is unavailable, and the version in the At block 630, the process determines whether the poHcy 

cache is too old to be served. It may include only a 45 causes a cache serve. The policy may override the validity 

"flag" or banner identifying the page as expired data, or and/or freshness determination. For example, the policy may 

it may be a separate design. state that data that has expired less than 5 minutes ago may 

In addition to the imiversal, or default, policy 530, the be served to users from AOL. Thus, while the TIL may 

user may set up category-specific policies 535, for various indicate that the data has expired, the poUcy may override, 

categories of pages. The categories of pages may be, for 50 If the policy causes a cache serve, the process continues to 

example, based on a particular root page. For example, all block 626, to send the UCI to the assembly engine. If the 

pages that are descended from the www.pivia.com/ policy does not cause a cache serve, the process continues to 

documentation/ root page may be designated as a category block 632. 

having a particular set of rules. Thus, the category-specific At block 632, the process determines whether the origin 

policy 535 may be set up. Note that the category-specific 55 server is available. If the origin server is available, the 

policy may simply be to designate pages in the category as process continues to block 618, to pass the URL to the origin 

"uncacheable." Furthermore, the user may set up UCI spe- server, for service. If the origin server is unavailable, the 

cific policies 540, for particular pages. For one embodiment, process continues to block 634. 

the user need only specify those parameters that are different At block 634, the process determines whether the unavail- 

fortheUCIspecificpolicy 540 from the universal policy 530 60 ability timer has expired. The unavailability timer deter- 

and/or the appropriate category-specific poUcy 535. mines that a stale page may be served for a period of time. 

FIG. 6A is a flowchart of one embodiment of routing a The unavailabiUty timer is set by the policy. If the timer has 

request. The process starts at block 610, when a request is not yet expired, the stale page may be served. Thus, the 

received from a chent. For one embodiment, the request is process continues to block 626, to send the UCI to the 

addressed to the origin server. The dynamic caching system 65 assembly engine. If the timer has expired, the process 

of the present invention intercepts the request destined for continues to block 636. At block 636, the stand-in page is 

the origin server. served, and the process ends, at block 640. 
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In this way, the present system permits the tiser's request At block 735, the process determiaes if the assembly is 

to be processed by a dynamic caching engine, and either complete. If not, the process returns to block 730, to 

served by the engine or proxied to the origin server for continue executing instructions. If the assembly is complete, 

service. the process continues to block 740. 

FIG. 6B is a flowchart of one embodiment of creating as At block 740, the completed page is assembled. At block 

unique URL (UCI). The process starts at block 660, when a 745, the page is served to the user. A copy of the page is sent 

URL and parameters are received. FIG. 6B corresponds to to the log. The log, for one embodiment, tracks the number 

block 620, of FIG. 6A, Returniog to FIG. 6B, at block 664, of requests for the page. This is used by the freshness engine, 

the process determines whether there are any parameters for to calculate future time-to-live information. For one 

analysis. If so, the process continues to block 670. embodiment, the log includes the UCI, the time of the 

At block 670, the parameter is identified. request, and the time of the response. The process then ends 

At block 672, the process determines whether the param- at block 749. 

eter is relevant. If not, the process, at block 674, discards the FIG. 7B illustrates one embodiment of executing the 

parameter. The process then returns to block 664, to deter- instructions of the compile object. The process starts at 

mine whether there are any further parameters for analysis. block 751. This process corresponds to block 730 of FIG. 

If the parameter is considered relevant, the process continues 7A, the execution of the instructions of the compile object, 

to block 676. At block 755, the process determines whether the element 

At block 676, the process determines whether the param- is static. If so, the process, at block 757 inserts the static 

eter is one of the categorized parameters. As discussed content into the appropriate location. The process then 

above, certain parameters may be treated differently by continues to block 795. At block 795, the process determines 

category. One such parameter may be, for example, the 20 whether there are any additional instructions/elements to 

user's ISP. Certain ISPs may be treated differently. For execute. If so, the process returns to block 755, to evaluate 

example, a user coming from AOL may be treated differently the next element. If, at block 755, the element was found not 

from a user having at-home DSL. For another example, to be a static element, the process continues to block 760. 

requests may be categorized by connection ^eed into slow- At block 760, the process determines whether the element 

modem connection, DSL, and ISDN connections. If the 25 is header information. If so, the process, at block 762, inserts 

parameter is a categorized parameter, the process continues the header information appropriately. Header information 

to block 678. At block 678, aU categories that the parameter provides formatting and linking information, for example in 

matches are identified, and the parameter descriptors are set. (he hypertext markup language (HTML) format. The pro- 

The process then returns to block 664, to determine whether cess then continues to block 795, to determine whether there 

there are any additional parameters remaining for analysis. 30 are more elements to evaluate. If, at block 760, the process 

If the parameter response is not categorized, the process determined that the element was not header information, the 

continues to block 678. At block 678, the parameter value is process continues to block 765. 

set as the parameter descriptor for the UCI. The process then At block 765, the process determines whether the element 

returns to block 664, to determine whether there are any is an "ESI include." An ESI include provides the ability to 

further parameters to handle. 35 fetch and include files to comprise a page, with each file 

If, at block 664, the process determines that there are no subject to its own configuration and control, its own sped- 

further parameters to evaluate, the process continues to fied time-to-live in cache, revalidation instructions, and so 

block 667. At block 667, a unique content identifier (UCI) is forth. Included documents can include ESI markup for 

generated by combining the appropriate parameter descrip- further ESI processing. The ESI processing may be recur- 

tor and stand-ins for parameters that were missing, in a 40 sive. If the element is an ESI include, at block 767, the ESI 

canonical order. Thus, the UCI always has the same form, include processing is preformed. The ESI include processing 

regardless of the parameters received and the content of the inserts additional instructions by reference. The ESI include 

UCI. The process then ends at block 668. As noted above, may cause the execution of another compile object, or the 

this description corresponds to "generating a UCI" described proxying of additional data from the origin server. In 

above. 45 general, an ESI include can invoke any action. This process 

FIG. 7A is a flowchart of one embodiment of assembling is, for one embodiment, in compliance with the ESI 

a response to serve dynamic content to a user. For one specification, as provided at viww.6si.org. The process then 

embodiment, this process takes place in the assembly engine continues to block 795, to determine \^ether there are 

255, as shown in FIG. 2. The process starts at block 705. additional elements to evaluate. If, at block 765, the element 

This process is initiated when the system determines that the 50 was determined not to be an ESI include, the process 

response to the request should be served from the object continues to block 770. 

store/cache. At block 770, the process determines whether the element 

At block 710, the UCI is received. At block 715, the is an ESI expression. An ESI expression is any expression 

compile object associated with the UCI is loaded from the supported by the ESI standard. If the element is an ESI 

object store, SS expression, at block 772, the ESI expression processing is 

At block 720, the process determines whether the request- preformed. The process then continues to block 795, to 

er's system can accept a compressed response. Some brows- determine whether there are additional elements to evaluate, 

ers and systems can decompress content on the fly. If the If, at block 770, the clement was determined not to be an ESI 

requester's system can accept compressed content, at block include, the process continues to block 775, 

722, the compressed instructions and data of the compile 60 At block 775, the process determines whether the element 

object are retrieved. The process then continues to block is a transient element. If so, the process continues to block 

730. If the requester's system cannot accept compressed 777. Otherwise, the process continues to bock 795, to 

content, at block 725, the uncompressed instructions and determine whether there are any additional elements to 

data are retrieved. The process then continues to block 730. evaluate. If there are no additional elements to evaluate, the 

At block 730, the instructions of the compile object are 65 process ends at block 799, 

executed. FIG. 7B illustrates one embodiment of the details If the element, at block 775, was identified as a transient 

of executing the instructions of the compile object. element, the process continues to block 777, 
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At block 777, the process determines whether the tran- 
sient element is a random number. Certain advertisements, 
such as doubleclick's banner ads, include a random number 
in the URL. If the transient element is a random number, 
then the random element is inserted at block 780. The 5 
process then continues to block 795, to determine whether 
there are more elements to evaluate. Otherwise, the process 
continues to block 785. 

At block 785, the process determines whether the tran- 
sient element is a rotated option. Rotated options are, for lo 
example, certain advertisements that are rotated (e.g. there 
arc 10 difiFerent advertisements, and each is displayed 1 time 
out of 10.) If the transient element is a rotated option, at 
block 787, the appropriate rotated option is inserted. For one 
embodiment, the user may, through policy interface, identify 15 
the options to be displayed. For another embodiment, the 
system collects the options until all options are in the cache. 
The process then continues to block 795, to determine 
whether there arc more elements to evaluate. Otherwise, the 
process continues to block 790. 20 

At block 790, the process determines whether the tran- 
sient element is a pass-through parameter. If so, at block 
792, the value of the transient parameter is coped from the 
request object to the embedded URLs. The process then 
continues to block 795, to determine whether there are more 25 
elements to evaluate. 

The above examples of element processing are provided 
as examples of a larger concept. Specifically, the concept is 
that each element of a page is processed. Furthermore, for 
one embodiment, the process separates out transient ele- 30 
ments. This permits the caching of dynamic but non- 
transient content, letting the dynamic cache reduce the load 
on an origin server. 

FIGS. 8A and 8B are flowcharts of one embodiment of 
handling data served by the data server. This process, for one 35 
embodiment, is executed in compilation engine 270, of FIG. 
2. The process starts at block 805. At block 807, the data 
requested by the user is received by the dynamic cache 
engine. 

At block 810, the process determines whether there is a 40 
surrogate control header. A surrogate control header indi- 
cates that the web page is being served requires compilation. 
If there is a surrogate control header, the process continues 
to block 812. 

At block 812, the data is compiled, to generate a compile 45 
object. At block 814, the object is assembled to reconstruct 
a completed page. Then, at block 820, the data is served to 
the user. If there is not a surrogate control header, the process 
continues directly to block 820, and the data is served to the 
user. 50 

At block 825, the process determines whether the data is 
cacheable. The cacheability of the data, as discussed above, 
is determined based on the policies set by the user. If the data 
is not cacheable, the process ends at block 830. If the data 
is cacheable, the process continues to block 835. 55 

At block 835, the page is compiled to generate a compile 
object, if that was not already done at block 812, The 
compile object is the instructions and data that are used to 
reconstruct the page. The compile object is discussed above 
with respect to FIG. 9, 60 

At block 840, the process determines whether a previous 
version of the same compile object can be found in the 
server. If no previous version is in the server, the process 
continues to block 845. At block 845, the process stores the 
compile object, and assigns a TTL (time-to-live period) and 65 
verification time (the time at which object was last verified) 
to it. For one embodiment, a CRC or similar checksum is 
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calculated for the compile object as well, and stored. The 
process then ends, at block 830. 

If the process determines that a copy of the object can be 
found in the cache, it continues to block 850. At block 850, 
the process determines whether the previous version in the 
cache is different from the current version. For one 
embodiment, it uses a CRC or similar checksum to make this 
comparison. If the object is different, at block 855, the object 
in the cache is replaced by the new compile object and a TTL 
and verification time is assigned to it. The process then 
continues to block 860. If the previous version is the same 
as the current veision, the process continues directly to block 
860. 

At block 860, the information is logged. For one 
embodiment, the information that is logged includes (he 
time that the data was requested, and whether or not the 
version cached was identical to the version newly fetched. 
This data is used by the freshness engine to determine the 
percentage of data that was served fresh, and to calculate the 
(ime-to-Hve. 

At block 865, shown in FIG. 8B, the time to live and 
verification time of the compile object in the cache is 
updated. The time-to-live is calculated by the freshness 
engine to reach a promised freshness percentage. One 
example of how such a freshness calculation may be imple- 
mented is described in co -pending application Ser. No, 
10/143,041, The verification time is set to the current time. 
The process then ends at block 870. 

FIG. 8C is a flowchart of one embodiment of compiling 
a page to create a compile object. For one embodiment, this 
process takes place in the compilation engine 270, of FIG. 
2, The process starts at block 875. FIG. 8C corresponds to 
block 835 of FIG. 8A. At block 880, the data in the page is 
identified. For one embodiment, the data is identified by its 
HTML tag delimiters. For another embodiment, alternative 
means of identifying textual and image data may be used. 

At block 885, transient elements are identified. As dis- 
cussed above, these transient elements may be indicated by 
the user, or may be identified based on format. 

At block 890, a set of instructions is created to reconstruct 
the data and transient elements in the correct format. The 
instructions are used to properly position and insert data and 
transient elements into the page. 

At block 892, a compressed version of the data and 
instruction set is created. This permits the dynamic cache 
engine to serve a compre.ssed version of the information to 
a ;iscr whose browser or interface is capable of decompress- 
ing such information. This decreases response time and 
bandvwdth. 

At block 895, a checksum of the instructions and data is 
created. The checksum, for one embodiment, is a 128-bit 
CRC. This checksum is used to determine whether a copy of 
the data in the cache is identical to this copy. For one 
embodiment, this checksum is stored as metadata associated 
with the compile object, such that it is only calculated once, 
and need not be calculated again to compare this version 
with a newer version of the compile object The process then 
ends at block 899. 

FIG. 11 is a flowchart of one embodiment of using 
triggers to invalidate compile objects in the cache. This 
process is continuously running as a detection mechanism, 
for one embodiment. 

At block 1120, the process determines whether a manual 
flush request has been received If a manual flush request is 
received, at block 1130, the compile object(s) that are 
affected by the flush request are invalidated and/or flushed. 
Such a manual flush request may be used, for example, if the 
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origin server is updated. For example, if the origin server 
includes data indicating current catalog contents, a manual 
flush may be used when the catalog is updated. For one 
embodiment, this tjrpe of interaction may be set up as part 
of updating the origin server. The process then returns to 
block 1120, to continue monitoring for flush actions. If no 
manual flush request is received, the process continues to 
block 1140. 

At block 1140, the process determines whether anyone 
associated with the origin server has made a change to the 
data, for example to a database. In one embodiment, the 
database change may prompt a database trigger that notifies 
the dynamic caching engine of the change. In that case, the 
process continues to block 1130, to invalidate/flush the 
relevant compile object(s). If no data change is detected at 
block 1140, the process continues to block 1150, 

At block 1150, the process determines whether data 
received through the web interface affects a page. As web 
browsers become the front-end of more and more 
applications, the web may be \ised to update the contents of 
the origin server. In that instance, the dynamic caching 
engine remains interposed between the requester and the 
origin server. Thus, the dynamic caching engine can initiate 
an automated flush operation, if a change is made to the 
contents of the origin server. Therefore, if an administrator 
makes a change to the underlying data through the web 
interface, the dynamic caching engine can initiate a flush 
operation. Alternatively, the data may be received from a 
chent system. This may occur, for example in an auction. If 
the user submits a bid, then the cached page indicating the 
previous price is out-of-date. Therefore, if such data input is 
identified, the process continues to block 1130, and auto- 
matically flushed/invalidates the cache. The process then 
returns to block 1120, to continue monitoring. If no data 
change is detected at block 1140, the process returns to bock 
1120, to continue monitoring for flush operations. 

Although the above processes are described in terms of 
flowcharts, the particular order of many of the processes 
may be altered and reversed. One skilled in the art would be 
able to determine which processes are dependent on order, 
and which may be executed in any order. 

In the foregoing specification, the invention has been 
described with reference to specific exemplary embodiments 
thereof It wiU, however, be evident that various modifica- 
tions and changes may be made thereto without departing 
from the broader spirit and scope of the invention as set forth 
in the appended claims. The specification and drawings are, 
accordingly, to be regarded in an illustrative rather than a 
restrictive sense. 

What is claimed is: 

1. A method of dynamicaUy caching data, the method 
comprising: 

creating a unique content identifier for a requested data 
set; 

retrieving the requested data set from an origin server, 
creating a compfle object of the requested data set; and 
on a subsequent request for the requested data set, assem- 
bling the compile object to reconstruct the requested 
data set, and serving the requested data set to a 
requester, without impacting the origin server. 

2. The method of claim 1, further comprising: 
determining if the compile object for the requested data 

set already exists in the cache; and if so 
determining if the copy in the cache is fresh; and 
if the copy in the cache is fresh, assembling the compfle 

object and serving the requested data set to the 

requester. 
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3. The method of claim 2, further comprising: 
if the copy in the cache is not fresh, 

fetching a new copy of the requested data set from the 

origin server; 
creating a compile object of the new copy; 
comparing the new copy to the copy in the cache; and 
replacing the copy in the cache if the new copy is 

different from the copy in the cadie. 

4. The method of claim 3, further comprising: 
updating a time-to-live of the copy in the cache. 

5. The method of claim 4, further comprising: 
determining a freshness of the data served to the request- 
ers; 

comparing the fireshness of the data served to an overall 
freshness level set by a policy of the origin server; and 

generating a new time-to-live based on a deviation from 
the overall freshness level, to achieve the overall fi^esh- 
ness level set by the policy. 

6. The method of claim 3, further comprising: 
creating a cyclic redundancy check (CRC) of the compile 

object of the new copy; and 
comparing the CRC of the compile object of the new copy 
to a CRC of the copy in the cache, wherein the CRC of 
the copy in the cache is stored in the cache, and is not 
newly calculated. 

7. The method of claim 1, wherein the compile object 
comprises: 

a set of instructions and a set of data, the set of instruc- 
tions indicating where to display the data. 

8. The method of claim 7, wherein the set of instructions 
further permit incorporation of data from the origin server. 

9. The method of claim 7, wherein the set of instructions 
further permit the generation of personalized data, based on 
parameters in the original request, 

10. The method of claim 7, wherein the set of instructions 
further permits the generation of transient data, unique for 
each response. 

11. The method of claim 7, wherein the compile object 
further comprises: 

a compressed set of instmctions and a compressed set of 
data, the compressed set of instructions and data used 
for systems that can process compressed data. 

12. The method of daim 1, further comprising: 
permitting the origin server administrator to set policies, 

the policies including one or more of the foUowing: a 
level of freshness, and cacheabiUty of various data sets, 
TTL override, unavailability timer, parameters, param- 
eter categories, transient data elements, personalization 
options, uncachcability designation, and error page 
layout 

13. The method of claim 12, further comprising: 

prior to reconstructing the compfle object, determining 
whether the requested data set is cacheable in accor- 
dance with the pohcy, and if so, creating the compfle 
object. 

14. The method of claim 1, wherein the unique content 
identifier comprises a URL and set of parameters in canoni- 
cal format. 

15. An apparattis for dynamic caching comprising: 

a UCI creator to create a unique content identifier for a 

request for a requested data set; 
a proxy receiving logic to receive the requested data set 

firom the origin server; 
an assembly engine to create a compfle object from the 

requested data set; 
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a compilation engine to, on a subsequent request for the 
data set, assemble the compile object to reconstruct the 
requested data set; and 

a response Logic to serve the requested data set to a 
requester, without impacting the origin server. 

16. The apparatus of claim 15, further comprising: 

a cache tester to determine if the compile object for the 
requested data set already exists in the cache; and if so 

a freshness tester to determine if the copy in the cache is 
fresh; and 

if the copy in the cache is fresh, the assembly engine to 
reconstruct the compile object and serve the requested 
data set to the requester. 

17. The apparatus of claim 16, further comprising: 
if the copy in the cache is not fresh, 

a proxy service logic to fetch a new copy of the 
requested data set from the origin server; 

the compilation engine to create a compile object of the 
new copy; 

a change detection logic to compare the new copy to the 

copy in the cache; and 
an updating logic to replace the copy in the cache if the 

new copy is different from the copy in the cache. 

18. The apparatus of claim 17, further comprising: 

a freshness engine to update a time-to-live of the copy in 
the cache. 

19. The apparatus of claim 18, further comprising: 

the freshness engine to determine a freshness of the data 
served to the requesters and comparing the freshness of 
the data served to an overall freshness level set by a 
policy of the origin server, and generate a new timc- 
to-live based on a deviation from the overall freshness 
level, to achieve the overall freshness level set by 
policy data set by an administrator. 

20. The apparatus of claim 17, further comprising: 

the change detection logic to create a cyclic redundancy 
check (CRQ of the compile object of the new copy and 
compare the CRC of the compile object of the new 
copy to a CRC of the copy in the cache, wherein the 
CRC of the copy in the cache is stored in the cache, and 
is not newly calculated. 

21. The apparatus of claim 15, wherein the compile object 
comprises: 

a set of instructions and a set of data, the set of instruc- 
tions indicating how to display the data. 

22. The apparatus of claim 21, wherein the set of instruc- 
tions further permits one or more of the following: incor- 
poration of data from the origin server, generation of per- 
sonalized data, based on parameters in the original request, 
and generation of transient data, xmique for each response. 

23. The apparatus of claim 21, wherein the compile object 
further comprises: 
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a compressed set of instructions and a compressed set of 
data, the compressed set of instructions and data used 
for systems that can process compressed data. 

24. The apparatus of claim 15, wherein the UCI creator 
5 comprises: 

a parameter identifier to identify parameters including 

absent parameters; and 
an ordering logic to generate a UCI including the original 

request and relevant parameters in canonical order, 

25. The apparatus of claim 24, wherein the UCI creator 
further comprises a parameter categorizer to replace a 
parameter with a parameter category. 

26. The apparatus of claim 15, further comprising: 

J 5 a policy user interface to permit an origin server admin- 
istrator to set policies, the policies including one or 
more of the following: a level of freshness and cache- 
ability of various data sets, TTL override, unavailability 
timer, parameters, parameter categories, transient data 

20 elements, personalization options, uncacheability 
designation, and error page layout; and 
a rule matcher to enforce the policies set by the admin- 
istrator. 

27. The apparatus of claim 26, further comprising: 

^ a policy engine to determine whether the requested data 
set is cache able in accordance with the policy, prior to 
the assembly engine creating the compile object. 

28. Adynamic caching server interposed between a client 
and an origin server, the dynamic caching server compris- 

30 ing: 

an inline server to intercept requests from the client to the 
origin server, the inline server comprising: 
a cache including a plurality of compile objects, each 

compile object representing dynamic web content; 
a UCI creator to create a unique content identifier for a 

request, the UCI associated with a compile object; 
an assembly engine to reconstruct the compile object to 

create the requested data set in response to the 

request; and 

a response logic to serve the requested data set to a 
requester, without impacting the origin server. 

29. The dynamic caching server of claim 28, further 
comprising: 

an ofiEline server to calculate a time-to-live function for the 
compile object in the cache, based on a freshness ratio. 

30. The dynamic caching server of claim 28, further 
comprising: 

a policy interface permitting an administrator of the origin 
50 server to set preferences for the dynamic caching 
engine, the preferences used by the offline server to set 
freshness ratios. 

* * « « * 
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